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A novel geomètric formalism for statistical estimation is applied here to 
the canonical distribution of classical statistical mechanics. In this scheme 
thermodynamic states, or equivalently, statistical mechanical states, can be 
characterised concisely in terms of the geometry of a submanifold Ai of the 
£h \ unit sphere S in a real Hilbert space Tí. The measurement of a thermodynamic 

' variable then corresponds to the reduction of a state vector in Tí to an eigen- 

■ state, where the transition probability is the Boltzmann weight. We derive 
i—* ■ a set of uncertainty relations for conjugate thermodynamic variables in the 

! , equilibrium thermodynamic states. These follow as a consequence of a strik- 

í> \ ing thermodynamic analogue of the Anandan-Aharonov relations in quantum 

' mechanics. As a result we are able to provide a resolution to the controversy 

■ surrounding the status of 'temperature fluctuations' in the canonical ensem- 
ble. By consideration of the curvature of the thermodynamic trajectory in its 

, state space we are then able to derive a series of higher order variance bounds, 

^> \ which we calculate explicitly to second order. 

PACS Numbers : 05.20.Gg, 05.70.Ce, 02.40.Ky, 02.50.Cw 

By a statistical model Ai we mean a family of probability distributions characterised 
by a set of parameters known as the parameter space. This possesses natural geometrical 
properties induced by the embedding of the family of probability distributions in the space of 
j> \ square-integrable functions on the relevant sample space. More precisely, by consideration of 
the parameterised square-root density function we can regard the space Ai as a submanifold 
of the unit sphere S in a real Hilbert space Tí. Therefore, Tí embodies the state space of 
the system, and the properties of the statistical model can be described in terms of the 
embedding of Ai in Tí. The geometry thus arising possesses a natural Riemannian mètric, 
the Fisher-Rao mètric, and as a consequence of this the powerful tools of differential geometry 
can be applied to various aspects of statistical inference. 

To what extent is this methodology applicable to statistical physics? In the present 
Letter, we focus on the statistical model Ai that constitutes the state space of classical 
statistical mechanics, for which the corresponding probability density is given by the Gibbs 
distribution. By taking the square root of this density, we can map, for each value of the 
parameter, the associated probability density to a vector in Tí. We are thus led to formulate 
a classical theory of measurement and statistical estimation in the language of Hilbert space 
geometry, with applications to classical and quantum statistical mechanics. This formulation 
of statistical theory ties up with the generalised probability theory due to Segal |J. Our 
aim here, however, is to formulate matters in a geomètric manner, in such a way that the 
statistical operations associated with estimation problems become more transparent. 
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As a consequence, we find that a classical thermodynamic state, in the energy repre- 
sentation, can be expressed as a real superposition of energy eigenstates, each having the 
square-root of the corresponding Boltzmann weight as coefficient. The temperature estima- 
tion in such equilibrium states suffers from an intrinsic uncertainty, leading to what we might 
call a thermodynamic uncertainty relation. The source of the uncertainty can be said to be 
thermal noise, which is analogous to the quantum noise that gives rise to the Heisenberg 
uncertainty relations. Indeed, quantum mechanical Schròdinger trajectòries can be obtained 
by Wick rotating the corresponding classical thermal trajectòries on S, and hence we can 
enquire to what extent Standard quantum mechanical relations have anàlogues in a classical 
thermodynamic system. We shall demonstrate, for example, that the classical relationship 
between the heat capacity of a system in thermal equilibrium and the energy variance in 
the associated Gibbs distribution is in direct correspondence with the Anandan-Aharonov 
relation [|| in quantum mechanics, which associates the velocity of a quantum mechanical 
state trajectory with the energy uncertainty along it. From there we are led to a series of 
higher order variance bounds on the temperature measurement, which also have quantum 
mechanical anàlogues ||. 

Consider a real Hilbert space TC with a symmetric inner product g ab . A probability den- 



sity function p(x) can be mapped into TC by taking the square-root ip(x) = <Jp(x), which 
is denoted by a vector ip a in TC. The normalisation condition f(ífj(x)) 2 dx = 1, written 
9ab4 ,a ' l l )b = I? indicates that ip a lies on the unit sphere S in TC. Since a probability den- 
sity function is nonnegative, the image of the mapping / : p(x) — > ip{x) is the intersection 
S + = S fi TC + of the sphere S in TC with the convex cone TC + formed by the totality of 
quadratically integrable nonnegative functions. We call ip a the state vector of the corre- 
sponding probability density p(x). 

A typical random variable is represented on TC by a symmetric tensor X ab , whose expec- 
tation in a normalised state ip a is -E^[X] = X ab ip a if) b . Similarly, the expectation of its square 
is X ac X^ijj a ijj b . The variance of X ab in the state ip a is therefore Var^,[A] = X ac X b 2 i{) a ijj b , 
where X ab = X ab — g ab E^[X] represents the deviation of X ab from its mean in the state ip a . 

Suppose we have a family of probability distributions that are conditioned to a set of 
parameters 9, with density function p(x, 9). Then, for each value of 9 we obtain a correspond- 
ing point on S given by íp a (9). This conditioning is characterised by the specification of a 
submanifold Ai in S. Assuming ip a (9) has continuous second derivatives, we find that M. is 
a Riemannian manifold, with the Fisher-Rao mètric = 4g ab diifj a djip b , where <9j = d/ 89* . 
This is the mètric induced on Ai by the spherical geometry of S. 

In a statistical mechanical context, the parametrised family of probability distribution 
takes the form of the Gibbs measure 



where the variable x ranges over the configuration space, Hj(x) represents the form of the 
energy, Wg is a normalisation factor, and q(x) determines the distribution at 9^ = 0. Our 
goal is to formulate a Hilbert space characterisation of this distribution. In fact, it can 
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be shown [[3] that the state vector ip a {9) in H corresponding to the Gibbs distribution ([[]) 
satisfies the differential equation 
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where Hj a b = Hj a b — g^E^Hj]. The solution of this equation is 



^ a {9) = exp 



d b , (3) 



where Wq = Wg — Wq and q a = ^°(0) is the prescribed distribution at 9^ = 0. The Fisher- 
Rao mètric for the parameter space Ai of the Gibbs distribution is Gij = didjWg. Thus, for 
models in statistical mechanics where the normalisation is known, or equivalently, for which 
the partition function is specified, one can study the geometry of Ai directly by use of this 
expression [|J. 

We are now in a position to set up a microscopic theory of measurement for thermo- 
dynamic systems. For simplicity, we consider a one parameter family of thermal states, 
letting (3 = l/ksT denote the usual inverse-temperature parameter and H a b the symmetric 
Hamiltonian for the system. For the state vector we have 



ip a (p) = exp 



Q b , (4) 



and for each value of the temperature we find a point on Ai in S. To be more specific, we 
have a unit sphere S in Tí, whose axes label the configurations of the system, each of which 
has a defmite energy. Suppose we let u% denote an orthonormal basis of vectors in Tí. Here, 
the index k labels all the points in the phase space of the given statistical system. In other 
words, for each point in phase space we have a corresponding basis vector in Tí for some 
value of k. With this choice of basis, a classical thermal state if) a {f3) can be expressed as a 
superposition 

^((3) = e-s^Je-s^J , (5) 

k 

where is the energy for fc-th configuration, and thus expfH 7 /?] = J2k exp(— is the 
partition function. The index k is formal here in the sense that the summation may if 
appropriate be replaced by an integration. By comparing equations and (^), we find 
that the /3 — thermal state q a is given by 

<f = e^E^. (6) 
fe 

which corresponds to the centre point in <S+. This relation reflects the fact that all con- 
figurations are equally likely to occur at infinite temperature, with probability exp(— Wq). 
The state trajectory ip a (l3) thus commences at the centre point q a , and follows a curve on 
S generated by the Hamiltonian H a b, for which the curvature is 

where (H n ) denotes the n-th central moment of the observable H a b- Here as usual 
the curvature of the curve ip a ((3), which is necessarily positive, is defined by K^((3) = 
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9ab'4 ) 2' l l ) 2i ^ (S'afegí V'l) 2 \ where = ip a — íp a i() b il!b/ip c ipc — vf)°"if) b íf)i ) is the 'acceleration' vector 
along ^ a (f3), and tp° = tp a is the 'velocity' (the dot denotes d/d[3). The acceleration satisfies 
ip%ip a — and ip%ipi a = 0. Note that ^"Va = since il> a (f3) lies on S. 

If the dimension of TC is infinite, the statistical model may exhibit a phase transition 
at a critical point (3 C . Then the curve proliferates into L distinct curves, where L is the 
multiplicity of the ground state degeneracy. Thus, for the thermal states it is important to 
fix the initial condition at /3 = 0, since any other point can be ambiguous. Physically, this 
ambiguity reflects the various coexisting phases allowed at the critical point. In particular, if 
the transition is of second order, the curvature is singular at j3 c . It follows from the expression 
(0) that the scaling behaviour of around (3 C is given by ~ \P\~ K , where f3 = f3 c / (3 — 1 
is the reduced temperature and k = 2 — a in terms of conventional critical exponents. The 
Standard relation 2 — a = du indicates that the curvature scales like correlation volume [|J . 

The simplest model for a measurement of the state can be described by projecting out a 
point in phase space. The resulting probability for observing the state u\ for some value of 
k is thus given by the Boltzmann weight 

Pk = (9<*ru b k ) 2 = e-e*- w ' • (8) 

This model can be extended to incorporate probability operator valued measures. For in- 
stance, suppose we are interested in the measurement of an observable X a b for a state 
ip a (/3). Then, the probability density for the measurement outcome x is the expectation 
p(x,/3) = ïl a b(X, x)ip a ilj b of the projection operator 

1 r°° 

n«(X, x) = exp [i\{X a b - x5D) d\ . 

V Z7T J— oo 

The choice of U a b can also include nonorthogonal resolution operators. 

Now let us turn to the measurement problem for thermal states. Our intention is to 
study the uncertainties arising in making inferences from the measurement outcomes. In 
general, we may wish to estimate the value of a function of an unknown parameter, such as 
internal energy or magnètic susceptibility. We shall consider, in particular, the case when 
we estimate the temperature. Suppose that B a b is an unbiased estimator for the parameter 
(3, so B a bip a ip b / g c dip c ip d = (3- Then, the variance in estimating f3 can be expressed |5]|| by 
the geometrical relation 

Var^B] = \g ab V a (3V b ^ (9) 

on the unit sphere S, where V a /3 = df3/dip a is the gradient of the temperature estimate 
(3. The essence of this relation can be understood as follows. First, recali that f3 is the 
expectation of the operator B ab in the state ip a (f3). Suppose that the state changes rapidly 
as P changes. Then, the variance in estimating f3 is small, and indeed, this is given by the 
squared magnitude of the 'functional derivative' of /3 with respect to the state ip a - O n the 
other hand, if the state does not change significantly as (3 changes, then the measurement 
outcome of an observable is less conclusive in determining the value of (3. A crude example 
is as follows. Suppose we infer the value of the temperature for a magnètic system from 
measurements of the magnetisation. If the measurement outcome is, say, close to zero, then 
the temperature can be any value above the Curie point, and the variance is large. 
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The squared length of the gradient vector V a /3 can be expressed as a sum of squares 
of orthogonal components. To this end, we choose a new set of orthogonal basis vectors 
given by the state ip a and its higher order derivatives. If we let ip® denote ip a for n = 0, 
and for n > the component of the derivative d n ip a /d(3 n orthogonal to the state ip a and 
its lower order derivatives, then our orthonormal vectors are given by ^ = ^nidbc^n^n)^ 1 ^ 2 
for n = 0, 1, 2, • ■ -. The reason for choosing this set instead of the original basis u% is for 
computational simplicity. With this choice of orthonormal vectors, we find that the variance 
of the estimator B satisfies the inequality 

for any range of the index n. This follows as a consequence of the fact that the squared 
magnitude of the vector |V a /3 = B a bip b is necessarily greater than or equal to the sum of 
the squares of its projections onto the basis vectors given by ip^ for the specified range of n. 

In particular, for n = 1 we have B a b^fip b — | on account of the relation B a bijj a ip b = /3, 
and gabipi^ = ^AH 2 , which follows from the differential equation dip a /d(3 = —^H^ip b . 
Therefore, as a consequence of equation (|ï~0|) , if we write Var </,[£?] = Af3 2 , we find for n = 1 
the following thermodynamic uncertainty relation: 

Af3 2 AH 2 > 1 (11) 

which is vàlid along the trajectory Ai consisting of the thermal equilibrium states ip a (f3). 
Interestingly, Landau and Lifshitz have obtained an inequality of this kind on the basis 
of temperature fluctuations. Kittel and Kroemer argue, on the other hand, that such an 
inequality is meaningless, since the temperature is a fixed constant by definition in the 
canonical distribution. The framework we have presented provides a mathematically and 
physically consistent solution to this long standing point of controversy 0. That is, (3 is 
indeed a fixed constant for a canonical ensemble, which does not fluctuate. However, for 
a given equilibrium system, if we wish to find the actual value of f3, there is an inevitable 
uncertainty associated with our estimation, characterised by (]TÏ|). 

While the variance bounds in (0) formally depend on the specific choice of the estimator 
B a b, we find, remarkably, that in the case of thermal states, these bounds are systematically 
independent of the estimator B. For example, for n = 2, the acceleration vector ^ i s given 
by the expression 

r 2 = \ (H a b H b c r - -jf^v - (h 2 )^ ■ 

To value the corresponding correction term in (|K]) we note that B a bip%ip b = B a bip%ip b 
on account of the orthogonality gabip^ = 0- Then, by differentiating the relation 
B a bip a ip b = (3, we obtain B a bH b ip a ip c = —1. Taking a second derivative we conclude that 
B a bH^H^ifj c ip d = (3(H 2 ), providing that B a b commutes with H a b, which is the case for clas- 
sical thermodynamic variables. Substitution of these relations into (0) yields a sharper 
thermodynamic uncertainty relation 

(H 3 ) 2 

Ap 2 AH 2 > 1 + -4 — '— , (12) 
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where the expression for the curvature is given in (]?]). It is clear that, by consid- 
eration of other equilibrium distributions such as grand canonical or P-T distributions, 
analogous relations can be derived, e.g., for chemical potential /i/fcgT and particle number 
N, or pressure P/Zc^T and volume V. The equality in ( |ÏT|) holds if the energy expecta- 
tion is proportional to the inverse temperature (3. It is also interesting to observe that by 
virtue of the formula 2B a -bip^ip b = 1, these conjugate variables satisfy the covariance relation 
E^[BH] — E^[B]E^[H] — — 1, which can be expressed in the form of the anticommutation 
relation {B,H}^ = —1, vàlid in expectation along the thermal trajectory. 

We note, incidentally, that the Fisher-Rao mètric G = Ag^ip^ip^ in this case is given 
by AH 2 = T 2 C, where C is the heat capacity. For systems exhibiting second order phase 
transitions, the heat capacity diverges at the critical point. Therefore, the temperature un- 
certainty A/3 2 can be made small in the vicinity of such critical points. This is due to the 
sensitivity of the state near critical points. Conversely, it is clear that temperature estima- 
tion becomes difficult for vàlues of (3 far from the critical value (3 C . The relation G = AH 2 
is the thermodynamic counterpart of the Anandan-Aharonov relation || in geomètric quan- 
tum mechanics. However, unlike the quantum case where G is constant along Schròdinger 
trajectòries, for thermal trajectòries G depends upon the parameter (3. In particular, we 
find that d@G = 2(H 3 ), which shows that for the higher order correction given in flT2| ) to be 
nontrivial, it suffices that the bound in ( PD should not be saturated. 

In the foregoing sketch of our theory of statistical measurement, we have observed that 
many Standard quantum mechanical operations are already present at an essentially classical 
level of probabilistic reasoning. This is surprising, since the general view in physics is that 
the Hilbert space structure associated with the space of states in nature is special to quantum 
theory, and has no analogue in classical probability theory and statistics. Therefore, we can 
ask to what extent quantum theory is distinguished from the classical probability theory 
discussed above. From the viewpoint of Hilbert space geometry, indeed, the quantum theory 
can be regarded in a certain sense as a special case of the generalised statistical theory. That 
is, the theory outlined above can be specialised to the space of quantum states by introducing 
a compatible complex structure J£ on the underlying real Hilbert space 7i. In this case, 
the state trajectory £ a (£), having the time t as parameter, satisfies the Schròdinger equation 
dÇ a /dt = JgHçÇ c and substitution of this into equation fllÜD , for n — 1, yields the quantum 
mechanical uncertainty relation At 2 AH 2 > 1/4. 

The constructions given above for the thermodynamic equilibrium states ip a {f3) and the 
Schròdinger trajectòries £ a (í) illustrate two examples of probabilistic theories that can be 
analysed within the framework of Hilbert space geometry. For nonequilibrium systems, on 
the other hand, we may need to consider statistical dynamics M, in which case the differential 
equation for the state ip a has to be modified appropriately. Once a model has been chosen, 
the formalism can be applied to study the geometrical and statistical properties of these 
systems. 

Our approach has been to view the thermodynamic state space as an example that 
can be put forth within the framework of a generalised statistics, with an emphasis on 
the geomètric structure of the underlying real Hilbert space. This generalised probability 
theory might at first appear to be formulated by way of an ad-hoc analogy with quantum 
theory. However, as we proceed, we find that the Hilbert space structure associated with the 
probability distributions is indeed the fundamental construction. In this formulation, various 
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concepts in statistical studies, such as the notion of uncertainty, have precise geomètric 
characterisations, hence allowing a transparent understanding of the underlying physics of 
the given model. We note that the higher order correction in fll^) can easily be calculated 
for specific models. For example, for an iV-spin Ising chain, we find that the correction term 
is given by 2sinh (/3J)/(N — 1), where J is the exchange integral. 
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